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Abstract. We study the configurational probability distribution of a mono-atomic 
gas with a finite number of particles N in the micro-canonical ensemble. We give two 
arguments why the thermodynamic entropy of the configurational subsystem involves 
Renyi's entropy function rather than that of Tsallis. The first argument is that the 
temperature of the configurational subsystem is equal to that of the kinetic subsystem. 
The second argument is that the instability of the pendulum, which occurs for energies 
close to the rotation threshold, is correctly reproduced. 



1. Introduction 

The recent interest in the micro-canonical ensemble [UEJSEIEJEIEIEIISI E2 ED] is 
driven by the awareness that this ensemble is the cornerstone of statistical mechanics. 
Of particular interest is the occurrence of thermodynamic instabilities in closed systems 
and their relation with phase transitions. The latter are usually studied in the context 
of the canonical ensemble. 

The present paper focuses on the configurational probability distribution of a mono- 
atomic gas with N interacting particles within a non-quantum-mechanical description. 
Recently [12], it was proved that this distribution belongs to the g-exponential family 
[131 [H US], with q = 1 - 2/(3N - 2). In the thermodynamic limit N oo it 
converges to the Boltzmann-Gibbs distribution. This observation places the statistical 
physics of real gases into the realm of Tsallis' non-extensive thermostatistics [TOJ ITT] . 
In the Tsallis community the belief reigns that the Tsallis entropy function is more 
appropriate than that of Renyi, although both are maximised by the same probability 
distributions. In favour of this point of view is the Lesche stability [181 HH1 ED] of 
the Tsallis entropy function. Moreover it has been proved that this entropy function is 
uniquely associated with the g-exponential family (up to a multiplicative and an additive 
constant). However, it was argued in [T2] that for the calculation of thermodynamic 
quantities the Renyi entropy function is more appropriate. This statement is elaborated 
in the present work. In addition, it is shown by means of the example of the pendulum 
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that the stability of the Tsallis entropy function makes it inappropriate to describe 
instabilities of closed systems. 

The pendulum is an interesting example because it has two distinct types of orbits: 
librational motion at low energy and rotational motion at high energy. The density of 
states oj{U) can be calculated analytically (see for instance [21J). It has a logarithmic 
singularity at the energy U c , which is the minimum value needed to allow rotational 
motion — see the Figure [TJ 




Figure 1. Density of states of the pendulum in reduced units 

The thermodynamic quantity central to the micro-canonical ensemble is the entropy 
S(U) as a function of the total energy U. Therefore, we start with it in the next Section. 
Sections 3 to 6 discuss the configurational probability distribution and its properties. 
Section 7 considers the ideal g special case. Section 8 deals with the example of 

the pendulum. Finally, Section 9 draws some conclusions. The short Appendix clarifies 
certain calculations. 

2. Micro-canonical entropies 

The entropy S(U), which is most often used for a gas of point particles in the classical 
micro-canonical ensemble, is 

S(U) = k B \nu(U), (1) 

where oo(U) is the iV-particle density of states. It is given by 

u(U) = c N I dpx - dpjv / dq 1 ---dq A r<J(l7-iZ"(q,p)). (2) 

Here, q., is the position of the j'-th particle and p^- is the conjugated momentum, 
i/(q, p) is the Hamiltonian. The constant Cn equals l/N\h 3N . The constant h has 
the same dimension as Planck's constant. It is inserted for dimensional reasons. This 
definition goes back to Boltzmann's idea of equal probability of the micro-canonical 
states and the corresponding well-known formula 5* = In W, where W is the number 
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of micro- canonical states. However, the choice ([I]) of the definition of entropy has some 
drawbacks. For instance, for the pendulum the entropy S(U) as a function of internal 
energy U is a piecewise convex function instead of a concave function [21]. The lack 
of concavity can be interpreted as a micro-canonical instability [TJ H]. But there is no 
physical reason why the pendulum should be classified as being unstable at all energies. 

The shortcomings of Boltzmann's entropy have been noticed long ago. A slightly 
different definition of entropy is [22"| 125] (see also in [23] the reference to the work of A. 
Schluter ) 

S{U) = k B In Q{U), (3) 
where Q(U) is the integral of uj(U) and is given by 

Q(U) — Cjv f dpi • • ■ dp N [ dqi • • ■ dq N Q(U - H(q, p)). (4) 

JR3N J R 3N 

Here, Q(x) is Heaviside's function. An immediate advantage of ([3]) is that the resulting 
expression for the temperature T, defined by the thermodynamic formula 

T " dl/' ( j 

coincides with the experimentally used notion of temperature. Indeed, there follows 

immediately 

kBT = WY (6) 

It is well-known that for classical mono-atomic gases the r.h.s. of coincides with 
twice the average kinetic energy per degree of freedom. Hence, the choice of ()3]) as the 
thermodynamic entropy has the advantage that the equipartition theorem, assigning 
ksT/2 to each degree of freedom, does hold for the kinetic energy also in the micro- 
canonical ensemble. Quite often the average kinetic energy per degree of freedom 
is experimentally accessible and provides a unique way to measure accurately the 
temperature of the system. 

3. The configurational subsystem 

The micro-canonical ensemble is described by the singular probability density function 

Mq,p) = -L^-%P))- ( ? ) 
where S(x) is Dirac's delta function. The normalization is so that 

l = c N dpi • ■ • dpjy / dqi • ■ ■ dq N f v (q, p). (8) 

JR3AT J R 3N 

For simplicity, we take only one conserved quantity into account, namely the total 
energy. Its value is fixed to U. 

In the simplest case the Hamiltonian is of the form 

1 - 

^p) = ^Eip^i 2+v ( ( i)' ( 9 ) 
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where V(q) is the potential energy due to interaction among the particles and between 
the particles and the walls of the system. It is then possible to integrate out the 
momenta. This leads to the configurational probability distribution, which is given 
by 

/n\3N f 

/r f (q) = / dpi • • ■ dp N fu(q, p). (10) 

The normalization is so that 

' ' ' ' f conf / 



1 = J^ dq^.-dq^/rHq)- (11) 



The constant a has been introduced for dimensional reasongjj. In the limit of an 
infinitely large system, this configurational system is described by a Boltzmann-Gibbs 
distribution. However, here we are interested in small systems where an exact evaluation 
of fllOp is necessary. A straightforward calculation yields 

r«(a) = i^(qg^ (12) 

Ju W e 3 ^/ 2 o;(t/)r(3iV/2)' K > 

with e = h 2 /limia? . 

4. The variational principle 

It was shown in [12] that the configurational probability distribution /™ nf (q) belongs to 
the g-exponential family, with q — 1 — 31 ^_ 2 - This implies [131 [HI US] that it maximizes 
the expression 

/(/) _ eir** (/) (13) 

for some value of 6, where 

^ = -T^ L dqi " ' dq " /(q) [(/(q)) " - 1] (U) 

with 

^(/) = i / d qi ..-d qj v/(q)V(q). (15) 
N\a 6N J R3 N 

This is called the variational principle. Note that /(/) is the Tsallis entropy function 
[16J up to one modification (replacement of the parameter q by 2 — q). The parameter 
9 turns out to be given by 

n_ 2-g 1 (m) 

l-q e 2 -i[T{'iN/2)i J j{U)} 1 -i' 1 J 

The maximisation of ffTBl is equivalent to the minimisation of the free energy (using 
/(/) as the entropy function appearing in the definition of the free energy). Replacing 
the Boltzmann-Gibbs-Shannon (BGS) entropy function by /(/) is necessary - - the 
configurational probability distribution /[} onf (q) does not maximize the BGS entropy 
function as a consequence of finite size effects. 

| Note that the normalisation here differs from that in [12] 
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Note that in p3] the definition ()14p of the entropy function contains an extra factor 
1/(2 — q) to fix its normalisation and to make it unique within a class of properly 
normalised entropy functions. This normalisation factor is not wanted in the present 
paper because it becomes negative when we use q = 3 in the example. 



/«(/) = -J— In 
1 — a 



(17) 



5. Renyi's entropy function 

It is tempting to identify the parameter 6 of the previous Section with the inverse 
temperature (3 = l/k-gT and to interpret ( fl3|) as the maximisation of the entropy 
function /(/) under the constraint that the average energy U conf (f) equals the given 
value U conf . However, in [12] an example was given showing that this identification of 
9 with P cannot be correct in general. It was noted that replacing the Tsallis entropy 
function by that of Renyi gives a more satisfactory result. This argument is now repeated 
in a more general setting. 

In the present context, Renyi's entropy function of order a is defined by 

AT } 3N I dq 1 ---dq iV /(q) a 

Let a = 2 - q. Then ([17} is linked to flU} by 

n/) = £(/(/)) (is) 

with 

Note that 

*L = \ (20 ) 

This derivative is strictly positive on the domain of definition of C,(u). Hence, £(u) 
is a monotonically increasing function. Therefore, the density f(q) is a maximizer 
of /(/) if and only if it maximizes I a (f). This means that from the point of view 
of the maximum entropy principle it does not make any difference whether one uses 
the Renyi entropy function or that of Tsallis. However, for the variational principle 
discussed in the previous Section, and for the definition of the temperature T via the 
thermodynamic formula ([3]) the function £(u) makes a difference. In the example of 
the pendulum, discussed further on, the variational principle is not satisfied when using 
Renyi's entropy function, while it is satisfied when using /(/). Also, the derivation 
which follows below shows that, when Renyi's entropy function is used, the temperature 
of the configurational subsystem equals the temperature T of the kinetic subsystem. 
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6. Configurational thermodynamics 



Let us now calculate the value of Renyi's entropy function for the configurational 
probability distribution (ITU]). One has 



n i /conf j 



nfl 

Use now that (see (TT2 



In 



N\a 3N 



dqi---d qjv (/r f (q)) 



2-q 



(/r f (q)) 1-9 



C/-V(q) 



Then (1211) simplifies to 

/a(/ con f) 



lnT 



e[Y(3N/2)euj(U)] l -i' 
3N\ 



(21) 



(22) 



2 -J 



- 1 In 



kin 



(23) 



3iV 

The claim is now that ( 123|) . when multiplied with &b, is the thermodynamic entropy 
S c (U) of the configurational subsystem. Note that e = h 2 jl-Kvna? is an arbitrary unit 
of energy. Note also that, using Stirling's approximation and U = 3NQ(U)/2uj(U), 
simplifies to 

1 



-S' 



conf 



(U) ~ \neoo(U) 
3N 



+ 



(24) 



To support our claim, let us calculate its prediction for the temperature of the 
configurational subsystem. One finds 



AS' 



conf 



^■conf ^JJ "conf 

+ h 



us 



3iV 



i 



l 



f/kir 



dU 

dU conf 



3N 



- 1 



Ijkh 



Using (see (26) of p2 

df/ conf 



dC/ 



3^V a/ kin 
2 w 



this becomes 



At 



3iV 



kn— = — ■ 



(25) 



(26) 



(27) 



T conf °2u kin ""n T' 

This shows that the configurational temperature, calculated starting from Renyi's 
entropy function, coincides with the temperature T defined by means of the modified 
Boltzmann entropy ([3]) and with the temperature of the kinetic subsystem. One 
concludes that the natural choice of entropy function for the configurational subsystem 
is Renyi's with a = 2 - q = 3N/(3N - 2). 

Finally, let us define a configurational heat capacity by 



C 



conf 



dU 



conf 



AS- 



conf 



dT 



dT 



(2* 
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Then one has in a trivial way 



c= au = d_ 

dT dT 



^Nk B T + U conf 



^Nk B + C conf . (29) 



7. The ideal gas 



Let us verify that the expression (1231) makes sense even for an ideal gas. In this case 
the density of states is 

u{u) = T0j2j vN (27rm)3AV2 um/2 "- (30) 

Evaluation of ([2"31 with U kin = U then gives 

S™< = k B N In + k B In ^ * fc B iV In (31) 

The configurational entropy of an ideal gas does not depend on the total energy or on 
the mass of the particles, as expected. The total entropy is 

S = k B kiQ(U) 
= k B N lnV+ ^Nk B In 27rmU 

+ A; B lnc iV -fcBlnr(3A^/2 + l). (32) 

Using Stirling's approximation, (I3"2l simplifies to 

S ~ k B N (In -^r + - In 2tt4t- + constant ] . (33) 
\ Na d 2 Ne J 

This expression coincides with the Sackur- Tetrode equation [25] for an appropriate 
choice of the constant term. The first term of (1331) is the configurational entropy 
contribution fl3T|) . the second term is the kinetic energy contribution. 



8. The pendulum 

Let us now consider the example of the pendulum. The Hamiltonian reads 

H = ^o 2 -k 2 /cos(0). (34) 

For low energy — k 2 I < U < k 2 I the motion is oscillatory. At large energy U > tt 2 I it 
rotates in one of the two possible directions. The density of states oj(U) can be written 

as 

d 2^21 



u(U) 



J dcf) ^U + Ik 2 cos. 



hn 

with Uq{u) given by 



dU h 

lo q (U/k 2 I). (35) 



If 1 .! 1 



Wn(u) = — / da; —= , — = — . if — 1 < u < 1, 

2tt J V^VT^^/1-u + {1 + u)x 
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UJ {U) 



1 

2^ 



dx 



-i 



\/l - x 2 \/x + u 



if 1 < u. 



(36) 



See the Figured! Note that the integrals appearing in ( 136]) are complete elliptic integrals 
of the first kind. For simplicity we chose now units in which n 2 I = 1 holds. We also fix 
h = 4/k. 




Figure 2. Kinetic energy U kln as a function of energy U 



Using the analytic expressions fl36|) . and the expression (J6J), it is straightforward to 
make a plot of the temperature T as a function of the energy U. See the Figure [2j Note 
that it is not a strictly increasing function. Due to the divergence of Uq(u) at u — 1 the 
temperature T has to vanish at both u = — 1 and w = +1. Hence it has a maximum 
in between. As a consequence, the free energy F, which is the Legendre transform of 
U(S), 

F(T) = U -TS (37) 
is a multi- valued function, when calculated by substituting U(T) in fl3T|) . See the Figure 

EJ 

When a fast rotating pendulum slows down due to friction then its energy decreases 
slowly. The average kinetic energy, which is the temperature tends to zero when 

the threshold U c is approached. In the Figure El the continuous curve is followed. The 
pendulum goes from a stable into a metastable rotational state, then it switches to 
an unstable librating state, characterised by a negative heat capacity. Finally it goes 
through the metastable and stable librational states. The first order phase transition 
cannot take place because in a nearly closed system the pendulum cannot get rid of the 
latent heat. Neither can it stay at the phase transition point because a coexistence of 
the two phases cannot be realised. 
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Figure 3. Free energy of the pendulum 



9. The configurational free energy of the pendulum 

For the example of the pendulum the number of degrees of freedom 3N in the expression 
for the non-extensivity parameter q has to be replaced by 1, so that q = 3 results. This is 
an anomalous value because < q < 1 has been assumed in the main part of the paper. 
See the Appendix for a discussion of the modifications needed to treat this situation. 

It remains true that the configurational probability distribution /£} onf (0) maximizes 
the Renyi entropy with a = 2 — q = — 1 within the set of all probability distributions 
having the same average potential energy ?7 conf . Next, using 

I J cconf 

— — r = ^— (38) 

as the definition of the temperature T of the configurational subsystem, one can plot 
the configurational free energy as a function of T. See the Figure HI 

One observes the same behaviour as in the Figure [3j The main difference is that in 
the rotational phase the configurational free energy is a convex rather than a concave 
function of the temperature T. This implies that the configurational entropy S conf is a 
decreasing function of T and that the heat capacity C coni = T(dS conf /dT) is negative. 
This is not in contradiction with the physical intuition that the fluctuations in potential 
energy decrease with increasing energy U. The instability of the configurational 
subsystem in the rotational phase is more than compensated by the stability of the 
kinetic subsystem, so that the free energy F(T) of the total system is concave. 
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1 n pconf 



0,5- 




-1 J 



Figure 4. Configurational free energy of the pendulum 
10. Conclusions 

In a previous paper [12] we have shown that the configurational probability distribution 
fv (l) °f a rea ^ niono-atomic gas with N particles always belongs to the g-exponential 
family, with q = 1 — 3Af 2 _ 2 . In the same paper it was argued, based on one example, that 
for the definition of the configurational temperature T the entropy function of Renyi is 
better suited than that of Tsallis. Here we show in the Section O that the same result 
holds for any real gas with a Hamiltonian of the usual form ([9]). 

It is well-known that Renyi's entropy function and that of Tsallis are related because 
each of them is a monotone function of the other. Hence, from the point of view of the 
maximum entropy principle the two entropy functions are equivalent. However, from 
the point of view of the variational principle (this is, the statement that the free energy 
is minimal in equilibrium) the two are not equivalent. This raises the need to distinguish 
between them. The result of the Section [H] then suggests that from a thermodynamic 
point of view Renyi's entropy function is the preferred choice. 

A further indication in the same direction comes from stability considerations. 
In the literature of non-extensive thermostatistics one studies the notion of Lesche 
stability [181 ESJ I2Q] . Tsallis' entropy function is Lesche-stable while Renyi's is not. The 
present paper focusses on thermodynamic stability, by which one usually understands 
the positivity of the heat capacity. 

A well-known property of the Boltzmann-Gibbs distribution is that it automatically 
leads to a positive heat capacity and that instabilities such as phase transitions are only 
possible in the thermodynamic limit. The entropy function which is maximised by 
the Boltzmann-Gibbs distribution is that of Boltzmann-Gibbs-Shannon (BGS). The 
Boltzmann-Gibbs distribution is known in statistics as the exponential family. Its 
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generalisation, needed here, is the g-exponential family. Both Tsallis' entropy function 
and that of Renyi are maximised by members of the g-exponential family. However, 
only Tsallis' entropy function shares with the BGS entropy function the property that 
the heat capacity is always positive — this has been proved in a very general context in 
[13J. For this reason, one can say that the Tsallis' entropy function is a stable entropy 
function. We have shown in the present paper with the explicit example of the pendulum 
that Renyi's entropy function is not stable in the above sense. 

The example of the pendulum was chosen because it exhibits two thermodynamic 
phases. At low energy the pendulum librates around its position of minimal energy. 
At high energy it rotates in one of the two possible directions. In an intermediate 
energy range the time-averaged kinetic energy drops when the total energy increases. 
If the kinetic energy is taken as a measure for the temperature then the pendulum is a 
simple example of a system with negative heat capacity. Hence, it is not such a surprise 
that, if we look for an instability, that we find it in this system. But this also means 
that Renyi's entropy function is able to describe the instability of the pendulum, while 
Tsallis' entropy function is not suited for this task. This is again an indication that 
Renyi's entropy function is an appropriate candidate for a statistical definition of the 
thermodynamic entropy of small systems. 



Appendix 

The configurational probability distribution of the pendulum is given by 

fu ni (4>) = (A.l) 

U hu{U)^/U + Ik 2 cos0 

It maximizes Renyi's entropy function with a = — 1. The maximal value equals 

1. . 1 f . , 1 



S coni (U) = h B ln- [ ■ 
2 a J 



f c u oni (<i>) 



2 



k-Q In — — / d(p \JU + Ik 2 cosip 

a?^I/2 J 

= h B \n^-u(U)Q(U). (A.2) 

Therefore the inverse of the configurational temperature is given by 
1 dS coni 

^conf ^jyconf 

u(Uy + u'(U)Q(U) dU 

B 2u(u)n(u) df/ conr 1 J 



But note that 

dU coni d 



U 



dU dU y 2u{U) ) 
uj'{U)Vt{U) + u 2 {U) 

2u 2 {U) ' 



(A.4) 
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Hence flA.3jl becomes 



1 - A (A.5) 



T conf Q(U)' 

This shows that the temperature of the configurational subsystem coincides with that 
of the kinetic subsystem — see (jBJ). 

It is now straightforward to make the parametric plot of Figure H] by plotting T as 
a function of U on the horizontal axis, and F = U — TS on the vertical axis. 
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